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Uslng  the  formal  Identity  Max  [(x, Ax)  -  2(x,y)]-  -  (y,Ay) 
we  have  In  previous  papers  studied  the  properties  of  the 
Green's  function  of  various  functional  equations  and  properties 
of  the  resolvent  operator.  Prom  this  latter  we  were  able  to 
deduce  properties  of  the  characteristic  functions  and 
characteristic  values. 

In  this  paper  we  show  how  variational  techniques  can  be 
applied  to  deduce  similar  properties  for  complex  operators  and 
for  operators  which  are  non— synmetrlc . 

For  complex  operators  we  use  a  rnln-raax  variation  and 
analytic  continuation,  If  necessary,  while  for  non-symmetrlc 
operators  we  use  an  Imbedding  technique,  plus  analytic  contin¬ 
uation  If  required.  A  non— symmetric  operator  Is  Imbedded  within 
a  family  of  symmetric  operators  associated  with  a  variational 
problem. 

Once  the  variational  problem  has  been  formulated  we  can 
apply  the  functional  equation  techniques  of  the  theory  of 
dynamic  programming. 
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PUNCTIONAL  EQUATIONS  IN  THE 
THEORY  OP  DYNAMIC  PPOORAMMINO — IX: 

VARIATIONAL  ANALYSIS,  ANALYTIC  CONTINUATION 
AND  DffiEDDINO  OF  OPERATORS 

Richard  Bellman  and  Shennan  Lehman 

1.  Introduction.  Consider  the  formal  Identity 

Max  [(x,Ax)  -  2(x,y)]  -  (y,A”^y),  (l.l) 

X 

where  x  la  an  element  of  a  apace  S,  and  A  la  a  aymmetrlc 
operator  defined  over  S  with  the  property  that  (x,Ax)  la 
negative  definite.  Since  the  Euler  equation  associated  with 
this  variational  problem  is  Ax  •  y,  we  see  that  the  element 
X  fumlahlng  the  maximum  la  given  In  terms  of  the  Inverse 
operator.  For  the  case  of  ordinary  or  partial  differential 
operators,  these  operators  are  expressible  In  terms  of  Green’s 
functions. 

On  the  other  hand,  several  classes  of  variational  problems 
of  this  type  can  be  treated  by  means  of  the  functional  equation 
technique  of  dynamic  programming.  Combining  the  two  approaches, 
we  can  derive  a  number  of  properties  of  Green's  functions.  Por 

the  case  of  second  order  linear  differential  operators,  these 

1  2 
techniques  were  applied  In  Bellman  and  Bellman  and  Lehman  , 

while  the  classical  Hadamard  variational  formula  for  the  Green's 

function  associated  with  second  order  partial  differential 

operators,  of  elliptic  type  was  obtained  In  this  fashion  In 

Bellman  and  Osborn^.  Similar  results  were  obtained  for  linear 

4  S 

Integral  operators  and  Jacobi  matrices  In  Bellman 

Since  this  approach  yields  results  In  a  quite  straightfor¬ 
ward  fashion.  It  Is  of  some  interest  to  see  whether  or  not  they 
can  be  extended  to  cover  cases  In  which  A  Is  not  necessarily 
negative  definite.  In  which  A  may  be  symmetric  and  complex, 

and  In  which  It  need  not  be  symnetrlc. 

2 

In  It  was  shown  how  analytic  continuation  could  be  used 
to  overcome  the  lack  of  positive  def Inltenesa .  Here  we  shall 
show  how  analytic  continuation  and  a  mln-max  variation  can  be 
used  to  treat  the  case  of  a  complex  symmetric  operator,  with 
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partlcular  reference  to  second  order  linear  differential  operators, 
and  how  analytic  continuation  and  an  Imbedding  technique  can  be 
used  to  handle  non— symmetric  operators.  Specific  applications 
will  be  given  subsequently. 

?.  Complex  Symmetric  Operators.  Let  A  +  IB  be  a  complex  sym¬ 
metric  operator.  The  equation  (A  +  lB)(x  -f  ly)  -  u  Iv  reduces 
to  the  two  real  equations 

Ax  -  By  -  u ,  Ay  -f  Bx  -  V .  (2.1) 

If  A  Is  negative  definite,  these  can  be  considered  to  be  the 
variational  equations  arising  from  the  problem  of  determining  the 
maximum  over  y  and  the  minimum  over  x  of  the  functional 

(y»Ay)  -  (x,Ax)  +  2(x,By)  -  2(u,x)  +  2(v,y).  (2.2) 

If  A  Is  not  negative  definite,  we  replace  by  A  -  zl  where  z 

Is  a  sufficiently  large  positive  scalar,  and  then  employ  analytic 

2 

continuation  as  In 


3.  The  Second  Order  Linear  Differential  Operator.  As  an  Illus¬ 
tration  of  this  technique,  consider  the  equation 

u"  (g(x)  +  lh(x))u  -  p(x)  +  lq(x)  (3.1) 

over  a  <  x  <  T.  Setting  u  •  v  +  Iw,  we  obtain  the  equations 

v"  +  g(x)v  -  h(x)w  -  p(x), 
w"  +  g(x)w  +  h(x)v  -  q(x). 


which  are  the  variational  equations  connected  with  the  problem  of 
determining  the  minimum  over  v  and  maximum  over  w  of  the 
functional 


r_  v'^  w'^  -f  g(x)v^  —  2h(x)vw  —  g(x)w^ 


-  2p(x)v 


2q(x)w 


dt 


(3.2) 


Since  this  functional  Is  convex  In  w'  and  concave  In  v'.  It 

la  easy  to  show  that  min  max  -  max  min. 

w  V  V  w 
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Wlth  this  Information,  the  functional  equation  technique 

2 

can  be  applied  as  In 

If  g(x)  Is  not  uniformly  positive  In  the  Interval  [a,'Q  , 

we  Introduce  the  function  z  ♦  g(x)  where  z  Is  a  sufficiently 

large  positive  quantity  and  employ  analytic  continuation,  as 
2 

Indicated  In 

In  a  variety  of  problems  In  mathematical  physics,  complex 
functions  occur  when  energy  dissipation  is  taken  into  account; 
cf.  Dolph  where  the  rain-max  formulation  is  discussed  in  detail. 

4.  Won— symmetric  Operators.  Let  A  be  a  non— symmetric  operator, 
A  /  A'.  In  order  to  study  A“\  and  the  resolvent  operator 
(A  ~  XI by  variational  techniques  we  consider  the  problem 
of  maximizing  the  functional 

(x,Bx)  +  (y,By)  +  2(x,Ay)  -  2(u,x)  -  2(v.y),  (4.1) 

Where  P  is  a  negative  definite  operator. 

The  variational  equations  are 

Bx  +  Ay  -  u, 

A ' X  +  By  ■  V . 


We  have  thus  Imbedded  the  equation  Ay  -  u,  not  necessarily  of 
variational  origin,  within  a  family  of  variational  equations. 

In  order  to  carry  out  the  analytic  continuation,  we  replace 
B  by  zB  and  study  the  analytic  character  of  the  symmetric 
matrix  operator 


M(z) 


^zB 

U' 


A  ' 

zB, 


and  its  Inverse,  as  functions  of  z.  Eventually  we  wish  to  set 
z  -  0  so  as  to  obtain 


M(0)  ^ 


0  A-1] 

-(A')-^  0  j 
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The  analytic  details  In  each  case  will  depend  upon  the 

nature  of  the  operators  A  and  B.  For  the  case  of  linear 

2 

differential  operators,  the  methods  given  In  will  yield  the 
desired  results. 
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